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(54) Image pickup apparatus 



(57) rt is provided an image pickup apparatus com- 
prising image pickup areas for picking up an image of a 
object by dividing the image into the plural areas; plural 
output portions each provided for each of the image 
pickup areas, for outputting image signals respectively 
from the image pickup areas; a calculation circuit for cal- 
culating correlation among the plural image signals 

FIG. 3 



respectively output from the plural output portions; and 
a correction circuit for performing a correction process- 
ing on the plural image signals output from the plural 
output portions, on the basis of the signal from the cal- 
culation circuit. 
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Description 

BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001 ] The present invention relates to an image pickup apparatus used in a digital camera or the like is structured 
to have plural image pickup areas used to pick up an image of a object by dividing the image into plural areas and plural 
output portions provided to correspond to the respective image pickup areas. Particularly, the present invention relates 
10 to a method which automatically discriminates output levels among plural outputs and corrects the output levels so as 
to eliminate unbalance of the plural outputs. 

Related Background Art 

15 [0002] Conventionally, a digital still camera having such a structure as shown in Fig. 1 has been known. In case of 
the structure shown in Fig. 1 , a system control CPU 1 00 detects a state change of a camera operation switch 1 01 (com- 
posed of a main switch and a release switch of a camera) caused by a photographer himself, and starts power supply- 
ing to other circuit blocks. 

[0003] An image of a object within a photographing picture range is formed on an image pickup element 104 
20 through main photographing optical systems 102 and 103, and an electrical signal from the image pickup element 104 
is converted into a predetermined digital signal for each pixel in due order by an A/D conversion circuit 106 through a 
CDS/AGC circuit 105. 

[0004] On the basis of a signal from a timing generator 108 which determines entire driving timing, the image 
pickup element 104 is driven by an output of a driver circuit 107 which horizontally and vertically drives each pixel, and 
25 thus the image pickup element 104 outputs an image signal. 

[0005] Similarly, the CDS/AGC circuit 105 which performs analog processing to the output from the image pickup 
element 104 to convert its level into a predetermined signal level and the A/D conversion circuit 106 operate on the 
basis of the timing from the timing generator 1 08. 

[0006] An output from the A/D conversion circuit 106 is input to a memory controller 115 through a selector 109 
30 which performs signal selection based on a signal from the system control CPU 100, and all signal outputs from the 
controller 1 15 are transferred to a frame memory 116. Therefore, since pixel data for each photographing frame is once 
stored in the frame memory 1 1 6 in this case, running (or successive) photographing or the like is performed as a writing 
operation to the frame memory 1 16. 

[0007] After the photographing ends, the contents of the frame memory 116 which stores the photographed data 
35 are transferred to a camera DSP 1 1 0 through the selector 1 09 under the control of the memory controller 1 1 5. The cam- 
era DSP 110 generates R, G and B color signals on the basis of the pixel data of the photographed data stored in the 
frame memory 116. 

[0008] Ordinarily, in the state before the photographing, this result is periodically (for each frame) transferred to a 
video memory 111, whereby finder display or the like is performed through a monitor display circuit 1 12. 
40 [0009] On the other hand, when the photographer himself performs the photographing operation by operating the 
camera operation switch 101, the pixel data of one frame is read from the frame memory 116, objected to image 
processing by the camera DSP 1 10, and once stored in a work memory 1 13, in response to the control signal from the 
system control CPU 100. 

[001 0] Subsequently, the data in the work memory 1 1 3 is compressed based on a predetermined compression for- 
45 mat by a compression and expansion circuit 1 1 4, and the compressed result is stored in an external nonvolatile memory 
1 1 7 (ordinarily a nonvolatile memory such as a flash memory is used). 

[0011] Conversely, when the photographer wishes to observe the picked-up image data after the photographing, 
the data which was compressed and stored in the external nonvolatile memory 1 1 7 is expanded to the ordinary data of 
each photographing pixel through the compression and expansion circuit 114, and the expanded result is transferred to 
so the video memory 111, whereby the image data can be observed on the monitor display circuit 112. 

[0012] As above, the ordinary digital camera is structured to convert the output from the image pickup element 104 
into the actual image data through processing circuits substantially in real time, and output the converted result to the 
memory or the monitor circuit. 

[001 3] On the other hand, in order to improve the capability of the running photographing or the like in such the dig- 
55 ital camera system as described above (e.g., in order to obtain the capability close to 10 frames / second), systematic 
improvement including improvement of the image pickup element is necessary. For example, it is necessary to increase 
a reading speed from the image pickup element, increase a writing speed of the image pickup element data to the frame 
memory, or the like. 
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[0014] Fig. 2 simply shows, as one of improvement methods, a structure of a two-output type device composed of 
the image pickup element such as a CCD. In this device, the horizontal CCD is divided into two. 
[0015] In the CCD of Fig. 2, charges of the respective pixels generated by a photodiode unit 90 are together trans- 
ferred to the vertical CCD at predetermined timing, and the charge of the vertical CCD for each line is transferred to 
5 horizontal CCD's 92 and 93 at next timing. 

[001 6] Here, the horizontal CCD's 92 transfer the charges to a left-side amplifier 94 at each transfer clock, and the 
horizontal CCD's 93 transfer the charges to a right-side amplifier 95 at each transfer clock, whereby the photographed 
image data of this CCD is divided into right and left in two on the boundary of the center of the picture, and the divided 
image data is read. 

10 [001 7] Although the amplifiers 94 and 95 are ordinarily manufactured within the CCD device, these amplifiers are 
laid out to the positions considerably away from each other, whereby relative accuracy of the amplifier 94 does not nec- 
essarily match with that of the amplifier 95 completely. For this reason, the outputs of the left and right pictures from the 
amplification are separately sent to CDS/AGC circuits 96 and 98 and adjusted by external adjustment means 97 and 
99, respectively, to match the left and right outputs to each other. 

15 [001 8] In the image pickup element capable of realizing such the high-speed reading as described above, a method 
to simultaneously read the signals from the two or more outputs is applied. This technique is indispensable to bring the 
digital camera in the future close to a silver salt camera further (the product having the specification of about 8 
frames/second has already been achieved in the silver salt camera of single lens reflex type). 
[001 9] To have the plural outputs becomes advantageous in the speed. However, from the viewpoint of matching of 

20 the output levels, to have the plural outputs becomes obviously disadvantageous as compared with to have only one 
output. 

[0020] In mere the manual adjustment method in which, e.g., the output levels are analog-adjusted in the conven- 
tional CDS/AGC circuit, or the output levels after A/D conversion are digital-adjusted by matching both the channels, 
the value of, e.g., VR resistance itself changes due to an environmental change even if the levels have been consider- 
25 ably matched at the manufacturing stage, whereby the possibility to which temperature characteristics of the two 
CDS/AGC circuits completely match with each other is extremely low. 

[0021 ] When such the reading method of the image pickup element as described above is performed, if the relative 
accuracy of both the left and right outputs exceeds ±1%, unbalance of the boundary on the picture is clearly recognized 
by a viewer. 

30 

SUMMARY OF THE INVENTION 

[0022] A concern of the present invention is to correct, in an image pickup apparatus which picks up an image of a 
object by dividing the image into plural image pickup areas, unbalance between image signals output from plural output 
35 portions provided for respective image pickup areas. 

[0023] According to one aspect of the present invention, it is provided an image pickup apparatus comprising: 

image pickup areas for picking up an image of a object by dividing the image into the plural areas; 
plural output portions, each provided for each of the image pickup areas, for outputting image signals respectively 
40 from the image pickup areas; 

calculation means for calculating correlation among the plural image signals respectively output from the plural out- 
put portions; and 

correction means for performing a correction processing on the plural image signals output from the plural output 
portions, on the basis of the signal output from the calculation means. 

45 

[0024] Other advantages and features of the present invention will become apparent from the following detailed 
description and the attached drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

50 

[0025] 

Fig. 1 is a block diagram showing a conventional example; 
Fig. 2 is a block diagram showing the conventional example; 
55 Fig. 3 is a block diagram showing the first to sixth embodiments of the present invention; 
Fig. 4 is a block diagram showing the first embodiment of the present invention; 
Fig. 5 is a block diagram showing the second embodiment of the present invention; 
Fig. 6 is a block diagram showing the third embodiment of the present invention; 
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Fig. 7 is a diagram showing the third embodiment of the present invention; 
Fig. 8 is a block diagram showing the fourth embodiment of the present invention; 
Fig. 9 is a diagram showing the fourth embodiment of the present invention; 
Fig. 10 is a flow chart showing the fourth embodiment of the present invention; 
5 Fig. 1 1 is a flow chart showing the fifth embodiment of the present invention; and 

Figs. 1 2A and 1 2B are block diagrams showing the sixth embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

10 [0026] Before the preferred embodiments of the present invention will be explained, the summary of the embodi- 
ments will be explained first hereinafter 

[0027] The embodiments of the present invention are directed to automatical correction of unbalance among the 

plural outoput portions in case of that an image pickup element having plural output portions is used. 

[0028] To achieve the automatical correction, each of plural outputs from the image pickup element is independ- 

15 ently processed, correlation for each output is discriminated, the amount of unbalance among the plural outputs is cal- 
culated, and correction based on the calculated amount is performed to a processing circuit system. 
[0029] For example, it is assumed that the image pickup element has two outputs, a signal obtained from one out- 
put is given as A, and a signal obtained from the other output is given as B. In this case, there is a method which auto- 
matically calculates the amount of unbalance between the two outputs on the basis of the relation among the average 

20 value of the signal outputs A, the average value of the signal outputs B, and the average value of the signal outputs A 
and B. 

[0030] Further, each of the plural outputs from the image pickup element is independently processed, the correla- 
tion of image data within a specific range of each output is discriminated, the amount of unbalance among the plural 
outputs is calculated, and the correction based on the amount of unbalance is performed to the actual processing circuit 
25 system. 

[0031] For example, it is assumed that the image pickup element has two outputs, a signal obtained from one out- 
put is given as A, and a signal obtained from the other output is given as B. In this case, there is a method which extracts 
from the outputs A and B the signals of only the pixel portion located in the vicinity of the boundary on the picture of the 
image pickup element, calculates the relation between these two output signals, and thus calculates the amount of 
30 unbalance between these two output signals. 

[0032] Further, in order to detect the amount of unbalance among the plural outputs from the image pickup ele- 
ment, a predetermined calibration mode is set to the body of the camera or the like. 

[0033] For example, in a case where calibration is periodically performed on the field by the photographer, when the 
calibration mode is set to the body of the camera, the ordinary photographing is not performed within the camera, but 
35 only the amount of unbalance among the plural outputs is calculated. In this case, there is a method in which the 
amount of unbalance among the plural outputs calculated in the calibration mode is set in the plural outputs as the cor- 
rection data when the actual photographing is performed. 

[0034] Further, in order to detect the amount of unbalance among the plural outputs from the image pickup ele- 
ment, a predetermined calibration mode is set to the body of the camera or the like, and the result is notified to the pho- 
40 tographer. 

[0035] For example, when the calibration photographing is performed, it is desired to the photographer to photo- 
graph or take a object the entire surface of which is white. However, when the photographer erroneously photographs 
a general object which has an extended contrast difference to the entire picture, there is a method which generates 
warning to indicate to the photographer that the photographed object is undesired as the object. 

45 [0036] Further, each of the plural outputs from the image pickup elements is independently processed, and the 
result is once stored in a memory or the like. By using a part of the data stored in this memory, the correlation of the 
respective outputs is accurately discriminated based on the calculation of the CPU or the like. Thus, the amount of 
unbalance among the plural outputs is calculated, and the actual correction data read from the memory is corrected 
based on the calculated amount of unbalance. 

so [0037] Fig. 3 is a block diagram showing an entire hardware structure according to the first to sixth embodiments of 
the present invention explained hereinafter. 

[0038] In Fig. 3, an image pickup element 1 having two outputs (CH1 and CH2) is driven by a driver circuit 2. Thus, 
the image pickup element 1 operates at a predetermined frequency to output photographing image data of left and right 
independently in the form that the entire picture of the element 1 is divided in two vertically. A TG / SSG circuit 3 is a 
55 timing generation circuit which outputs a vertical sync signal VD and a horizontal sync signal HD, and simultaneously 
supplies a timing signal to each circuit block. 

[0039] An image output from the right-half of the image pickup element 1 is input to a CDS/AGC circuit 5 through 
the output CH1 and objected to known correlation double sampling, thereby eliminating a reset noise or the like 



4 



5/17/2007, EAST Version: 2.1.0.14 



EP1033 868 A1 

included in the CCD output and operating the AGC circuit which amplifies the output up to a predetermined signal level. 
An output from the CDS/AGC circuit 5 is input to an A/D conversion circuit 7 to convert it into a digital signal, thereby 
obtaining an output AD-CH1 . 

[0040] Similarly, an image output from the left-half of the image pickup element 1 is input to a CDS /AGC circuit 4 
5 through the output CH2 and objected to the known correlation double sampling, thereby eliminating the reset noise or 
the like included in the CCD output and operating the AGC circuit which amplifies the output up to the predetermined 
signal level. An output from the CDS / AGC circuit 4 is input to an A/D conversion circuit 6 to convert it into a digital sig- 
nal, thereby obtaining an output AD-CH2. 

[0041] After each of the left and right outputs from the image pickup element 1 is independently converted into the 
10 digital data, both the outputs are stored respectively in memories 9 and 1 1 through memory controllers 8 and 10 in due 
order. 

[0042] Further, the outputs AD-CH1 and AD-CH2 are simultaneously input to an unbalance amount calculation cir- 
cuit 1 8. In the unbalance amount calculation circuit 1 8, the amount of unbalance for each output is calculated in a later- 
described method, and thus the optimum amount of correction is determined. 

15 [0043] Since the memory controllers 8 and 1 0 have been constructed so as to continuously, time-divisionally exe- 
cute the reading and writing to the memories 9 and 1 1 respectively, as the output from the image pickup element 1 is 
written in the memory, the data already written in the memory at another timing can be read in the order of data writing. 
[0044] First, for the output CH1 of the image pickup element 1 , the data is continuously read from the memory 1 1 
under the control of the memory controller 1 0 and input to an offset adjustment circuit 1 3. Here, since a predetermined 

20 offset output OF1 calculated and set by the unbalance amount calculation circuit 18 is connected to the other input of 
the offset adjustment circuit 13, the data for the output CH1 and the output OF1 are added in the offset adjustment cir- 
cuit 13. 

[0045] Next, the output from the offset adjustment circuit 1 3 is input to a gain adjustment circuit 15. Since a prede- 
termined gain output GN1 calculated and set by the unbalance amount calculation circuit 18 is connected to the other 
25 input of the gain adjustment circuit 15, the data from the offset adjustment circuit 13 and the gain output GN1 are mul- 
tiplied in the gain adjustment circuit 15. 

[0046] Similarly, for the output CH2 of the image pickup element 1 , the data is continuously read from the memory 
9 under the control of the memory controller 8 and input to an offset adjustment circuit 12. Here, since a predetermined 
offset output OF2 calculated and set by the unbalance amount calculation circuit 18 is connected to the other input of 
30 the offset adjustment circuit 1 2, the data for the output CH2 and the output OF2 are added in the offset adjustment cir- 
cuit 12. 

[0047] Next, the output from the offset adjustment circuit 1 2 is input to a gain adjustment circuit 1 4. Since a prede- 
termined gain output GN2 calculated and set by the unbalance amount calculation circuit 18 is connected to the other 
input of the gain adjustment circuit 14, the data from the offset adjustment circuit 12 and the gain output GN2 are mul- 

35 tiplied in the gain adjustment circuit 1 4. 

[0048] The image data output which is obtained by correcting the amount of unbalance between the two outputs 
with use of the unbalance amount calculation circuit as described above is converted into one image data by an image 
synthesization circuit 16 (i.e., the left and right outputs are made one output), and objected to predetermined color 
processing (i.e., color interpolation processing, gamma conversion and the like) by a next-stage color processing circuit 

40 17. 

[0049] Next, entire control will be explained. 

[0050] A system control CPU 1 9 detects a setting state of a mode setting means 20. For example, when the camera 
is set to the calibration mode as a whole by the photographer, the system control CPU 19 detects and notifies such a 
state to the unbalance amount calculation circuit 18. 

45 [0051 ] The unbalance amount calculation circuit 1 8 calculates the amount of unbalance of the image photographed 
according to a release operation by the photographer, in such the method as described above. In this case, when the 
entire photographed picture is inadequate for the calibration (e.g., a case of that when a object having uneven face is 
selected by the photographer, and it is possible to obviously discriminate that such unevenness does not originate in 
the unbalance between the two outputs), a display and warning means 21 notifies the photographer that the current 

so object is inadequate. Therefore, on the basis of such a result, the photographer again selects a photographing scene 
optimum for the calibration. 

[0052] The first embodiment of the present invention will be explained. Fig. 4 shows the concrete structure of the 
unbalance amount calculation circuit 18. 

[0053] In Fig. 4, the outputs AD-CH1 and AD-CH2 from the A/D conversion circuit are first input to average value 
55 calculation circuits 30, 31 and 32. Here, the average value calculation circuit averages the data for each pixel over a 
' predetermined range, and the area to be averaged is set by an area selection circuit 33. 
[0054] The area selection circuit 33 determines the effective area of the data for each pixel output from the image 
pickup element 1 and sets the timing for permitting the input signal to be averaged by each average value calculation 
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circuit, on the basis of a VD/HD signal from the TG/SSG circuit 3 shown in Fig. 3. 

[0055] For example, the average value calculation circuit 30 calculates the average value of the pixel data existing 
in a slash portion a of an image area 42 in the image pickup element, and the average value calculation circuit 32 cal- 
culates the average value of the pixel data existing in a slash portion b of the image area 42. 
5 [0056] On the other hand, the average value calculation circuit 31 calculates the average value of the pixel data 
existing in the slash portions a and b of the image area 42 in the image pickup element. 

[0057] Thus, in this case, the average value of the pixel data within the predetermined range existing in the left half 
of the image pickup element 1 shown in Fig. 3 is calculated by the average value calculation circuit 30, the average 
value of the pixel data within the predetermined range existing in the right half of the image pickup element 1 is calcu- 
10 lated by the average value calculation circuit 31 , and the average value of the pixel data within the predetermined range 
existing in both the left and right halves of the image pickup element 1 is calculated by the average value calculation 
circuit 32. 

[0058] Next, outputs V 2 , V 1+2 and V 1 respectively generated from the average value calculation circuits 30, 31 and 
32 are divided by division circuits 34 and 35 the outputs of which are connected to next-stage circuits. 
15 [0059] First, the divide V u2 /V 2 is performed by the division circuit 34, and the value substantially proportional to the 
divided result is output as a signal GN2 from a correction data calculation circuit 38. similarly, the divide V U2 /Vi is per- 
formed by the division circuit 35, and the value substantially proportional to the divided result is output as a signal GN1 
from a correction data calculation circuit 39. 

[0060] The output signals GN1 and GN2 obtained as above are input to the gain adjustment circuits 15 and 14 of 
20 Fig. 3, respectively, and the actual correction is performed in these circuits to match the output levels of both the chan- 
nels with each other. 

[0061] On the other hand, the outputs from the average value calculation circuits 30, 31 and 32 are objected to sub- 
traction by next-stage subtraction circuits 36 and 37. 

[0062] First, the subtraction V 1+2 - V 2 is performed by the subtraction circuit 36, and the value substantially propor- 
25 tional to the subtraction result is output as a signal OF2 from a correction data calculation circuit 40. Similarly, the sub- 
traction V 1+2 - Vj is performed by the subtraction circuit 37, and the value substantially proportional to the subtraction 
result is output as a signal OF1 from a correction data calculation circuit 41. 

[0063] The output signals OF1 and OF2 obtained as above are input to the offset adjustment circuits 13 and 12 of 
Fig. 3, respectively, and the actual correction is performed in these circuits to match the output levels of both the chan- 
30 nels with each other. 

[0064] The above two methods try to correct the unbalance between the two outputs from the image pickup ele- 
ment to the end, by using the average value of the pixel data within the predetermined range existing in the left half of 
the image pickup element 1 , the average value of the pixel data within the predetermined range existing in the right half 
of the image pickup element 1, and the average value of the pixel data within the predetermined range existing in both 
35 the left and right halves of the image pickup element 1 . 

[0065] As above, there are the two kinds of methods, one for performing the gain adjustment to the data between 
the two outputs, and the other for performing the offset adjustment to the data between the two outputs. In the present 
embodiment, it is possible to perform the unbalance adjustment by using both the methods, or by selecting either one 
of the two methods. 

40 [0066] Next, the second embodiment will be explained. Fig. 5 shows the concrete structure of the unbalance 
amount calculation circuit 18. 

[0067] In Fig. 5. the outputs AD-CH1 and AD-CH2 from the A/D conversion circuit are first input to average value 
calculation circuits 30 and 32 identical with those in Fig. 4. Here, the average value calculation circuit averages the data 
for each pixel over a predetermined range, and the area to be averaged is set by an area selection circuit 33. 
45 [0068] The area selection circuit 33 determines the effective area of the data for each pixel output from the image 
pickup element 1 and sets the timing for permitting the input signal to be averaged by each average value calculation 
circuit, on the basis of the VD/HD signal from the TG/SSG circuit 3 shown in Fig. 3. 

[0069] For example, the average value calculation circuit 30 calculates the average value of the pixel data existing 
in a slash portion a of an image area 42 in the image pickup element, and the average value calculation circuit 32 cal- 

so culates the average value of the pixel data existing in a slash portion b of the image area 42. 

[0070] Thus, in this case, the average value of the pixel data within the predetermined range existing in the left half 
of the image pickup element 1 shown in Fig. 3 is calculated by the average value calculation circuit 30, and the average 
value of the pixel data within the predetermined range existing in the right half of the jmage pickup element 1 is calcu- 
lated by the average value calculation circuit 32. 

55 [0071] Next, outputs V 2 and V 1 respectively generated from the average value calculation circuits 30 and 32 are 
divided by a division circuit 43 the output of which is connected to next-stage circuit. The divide V 2 N<\ is performed by 
the division circuit 43, and the value substantially proportional to the divided result is output as a signal GN1 from a cor- 
rection data calculation circuit 45. On the other hand, a fixed output is generated as a signal GN2 from a fixed output 
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generation circuit 47. 

[0072] The output signals GN1 and GN2 obtained as above are input to the gain adjustment circuits 15 and 14 of 
Fig. 3, respectively, and the actual correction is performed in these circuits to match the output levels of both the chan- 
nels with each other. 

5 [0073] On the other hand, the outputs from the average value calculation circuits 30 and 32 are objected to subtrac- 
tion by a next-stage subtraction circuit 44. 

[0074] First, the subtraction V 2 - is performed by the subtraction circuit 44, and the value substantially propor- 
tional to the subtraction result is output as a signal OF1 from a correction data calculation circuit 46. On the other hand, 
a fixed output is generated as a signal OF2 from a fixed output generation circuit 48. 
w [0075] The output signals OF1 and OF2 obtained as above are input to the offset adjustment circuits 1 3 and 1 2 of 
Fig. 3, respectively, and the actual correction is performed in these circuits to match the output levels of both the chan- 
nels with each other. 

[0076] The above two methods try to correct the unbalance between the two outputs from the image pickup ele- 
ment to the end, by using the relation of the average value of the pixel data within the predetermined range existing in 
15 the left half of the image pickup element and the average value of the pixel data within the predetermined range existing 
in the right half of the image pickup element. 

[0077] Like the first embodiment, there are the two kinds of methods, one for performing the gain adjustment to the 
data between the two outputs, and the other for performing the offset adjustment to the data between the two outputs. 
In the present embodiment, it is possible to perform the unbalance adjustment by using both the methods, or by select- 
20 ing either one of the two methods. 

[0078] Next, the third embodiment will be explained. Fig. 6 shows the concrete structure of the unbalance amount 
calculation circuit 18. 

[0079] In Fig. 6, the outputs AD-CH1 and AD-CH2 from the A/D conversion circuit are first input to memories 55 
and 54 through memory controllers 53 and 52, respectively. 
25 [0080] Here, the range of the image pickup element data to be stored in the memory through the memory controller 
is determined at predetermined timing generated by a timing generation circuit 50. In this case, the ranges of the input 
data correspond to blocWine data in the vertical direction indicated by characters a and b in Fig. 7. The blocks indicated 
by a and b include each color data (G / R / B /G in this case) determined according to a color filter arrangement of the 
image pickup element. 

30 [0081 ] Therefore, the data is read for each block from the memories 55 and 54 through the memory controllers 53 
and 52, and simple addition is performed for each color in the block by next-stage luminance signal generation circuits 
57 and 56 to generate simple luminance signals. 

Y = R + 2G + B 

35 

[0082] The luminance signals generated by the luminance signal generation circuits 57 and 56 are sequentially 
read along the Y direction in Fig. 7, and processing such as one-dimensional low-pass filtering or the like for the reading 
direction (Y direction) is performed by low-pass filters 59 and 58. The result of the processing is graphed with the solid 
lines as graphs A and B shown in Fig. 7. 
40 [0083] Next, the outputs from the low-pass filters 59 and 58 are input to offset addition circuits 63 and 62, respec- 
tively. The other input of each of the offset addition circuits 63 and 62 is connected to the output of an offset setting cir- 
cuit 60. 

[0084] In the initial state, the output of the offset setting circuit 60 is zero. In this state, the outputs from the offset 
addition circuits 63 and 62 are first input to a next-stage correlation calculation circuit 64 and objected to correlation cal- 
45 culation. 

[0085] As the calculation method by the correlation calculation circuit 64, for example, if it is assumed that each 
luminance data of the block a at the left of the central boundary portion on the picture of the image pickup element in 
Fig. 7 is la(i) and each luminance data of the block b at the right thereof is lb (i), the correlation calculation is performed 
by using an expression P = X|la (i) - lb (i) | . 
so [0086] The result of the correlation calculation is discriminated by a total discrimination circuit 51 . When it is dis- 
criminated that the correlation is insufficient yet, a predetermined offset amount is calculated by the offset setting circuit 
60 and supplied to the offset addition circuits 63 and 62. 

[0087] For example, in the graphs A and B of Fig. 7, the plus offset amount is added for the luminance data la(i) 
and the minus offset amount is added for the luminance data (b(i). The result after the offset amounts are added is again 
55 objected to the correlation calculation by the correlation calculation circuit 64, and the calculated result is discriminated 
by the total discrimination circuit 51 . 

[0088] When it is discriminated that the result of the correlation calculation is sufficient, it is possible to consider that 
the results of both the outputs overlap each other. Thus, outputs OF1 and OF2 of the offset setting circuit 60 which was 
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set at that time are input to the offset adjustment circuits 13 and 12 so as to correct the unbalance between the two 
channels of the image pickup element 

[0089] Next, the outputs of the low-pass filters 59 and 58 are input to gain multiplication circuits 66 and 65, respec- 
tively. The other input of each of the gain multiplication circuits 66 and 65 is connected to the output of a gain setting 
5 circuit 61 . 

[0090] In the initial state, the output of the gain setting circuit 61 is zero. In this state, the outputs from the gain mul- 
tiplication circuits 66 and 65 are first input to a nest-stage correlation calculation circuit 67 and objected to correlation 
calculation. 

[0091] As the calculation method by the correlation calculation circuit 67, for example, if it is assumed that each 

10 luminance data of the block a at the left of the central boundary portion on the picture plane of the image pickup element 
in Fig. 7 is la (i) and each luminance data of the block b at the right thereof is lb (i), the correlation calculation is per- 
formed by using an expression P = l|la(i) x lb (i) | in an example. 
• [0092] The result of the correlation calculation is discriminated by the total discrimination circuit 51 . When it is dis- 
criminated that the correlation is insufficient yet, a predetermined gain amount is calculated by the gain setting circuit 

is 61 and supplied to the gain multiplication circuits 66 and 65. 

[0093] Conversely, when it is discriminated that the result of the correlation calculation is sufficient, it is possible to 
consider that the results of both the outputs overlap each other. Thus, outputs GN1 and GN2 of the gain setting circuit 
61 which was set at that time are input to the gain adjustment circuits 1 5 and 14 of Fig. 3 so as to correct the unbalance 
between the two channels of the image pickup element. 

20 [0094] The above two methods try to correct the unbalance between the two outputs from the image pickup ele- 
ment to the end, by discriminating the correlation of the pixel data within the predetermined range existing in the left half 
of the image pickup element and the pixel data within the predetermined range existing in the right half of the image 
pickup element, and setting the predetermined offset amount or gain .amount according to the discriminated result 
[0095] In the present embodiment, the output from the luminance signal generation circuit is objected to the low- 

25 pass filtering processing. In addition to such the method, a method for performing the correlation calculation to the 
band-pass filtered result, and a method for adjusting the amount of unbalance between the left and right outputs by add- 
ing little-more highly developed condition judgment (e.g., by selecting the partial area) are devised. 
[0096] Besides, like the first embodiment, there are the two kinds of methods, one for performing the gain adjust- 
ment to the data between the two outputs, and the other for performing the offset adjustment to the data between the 

30 two outputs. In the present embodiment, it is possible to perform the unbalance adjustment by using both the methods, 
or by selecting either one of the two methods. 

[0097] Next, the fourth embodiment will be explained. Fig. 8 shows the concrete structure of the unbalance amount 
calculation circuit 18. 

[0098] In Fig. 8, calculation circuits 130 to 137 are designated by a function selection circuit 146 which can select 
35 the plural calculation circuits for each of the left and right outputs. As the calculation circuits, an average value calcula- 
tion circuit, a maximum value calculation circuit, a minimum value calculation circuit, a dispersion value calculation cir- 
cuit, a standard deviation value calculation circuit, an average deviation calculation circuit, an inclination value 
calculation circuit, a difference maximum value calculation circuit, a difference minimum value calculation circuit, a dif- 
ference average value calculation circuit and the like are devised. A statistic of each of the left and right output data is 
40 calculated by these calculation circuits. Outputs AD-CH1 and AD-CH2 from the A/D conversion circuit are input to the 
plural calculation circuits selected by the function selection circuit 146. 

[0099] At this time, a predetermined area which is used to calculate the amount of unbalance in the image data is 
selected by an area selection circuit 145 for each calculation circuit selected by the function selection circuit 146. The 
area selection circuit 145 determines the effective area of the data for each pixel output from the image pickup element 

45 1 and sets the timing for permitting the input signal to be calculated by each calculation circuit, on the basis of the 
VD/HD signal from the TG/SSG circuit 3 shown in Fig. 3. Fig. 9 shows one example of the selection method of the area 
selection circuit 1 45. In Fig. 9, the specific positions are horizontally designated from the boundary of the image data to 
the left and right directions respectively. Further, the set of pixels having a color filter arrangement of R/G/G/B is made 
one cell, and continuous areas c(y) and d(y) from the boundary to the horizontally designated left and right positions 

so are considered at a position y in the vertical direction. The correlation of the set of the areas c(y) and d(y) is discrimi- 
nated for the arbitrary position y in the vertical direction. The area setting circuit can designate only the pixel having the 
specific color filter in the unit pixel set, or designate the combination of these pixels. Also, the area selection circuit 145 
may select a different area for each calculation circuit. 

[0100] Next, a memory controller 138 once stores the calculation data for the output AD-CH1 calculated by the cal- 
55 culation circuits 130 to 137, in a memory 139. 

[0101] Next, a correction data calculation circuit 142 reads out the calculation data for the output AD-CH2 and the 
calculation data for the output AD-CH1 from the memories 139 and 141 through the memory controllers 138 and 140, 
respectively. The calculation circuit 142 performs the correlation calculation for the calculation data in a later-described 
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method, thereby calculating gain correction data GN2 and offset correction data OF2 for the output AD-CH2. Similarly, 
a correction data calculation circuit 143 reads out the calculation data for the output AD-CH2 and the calculation data 
for the output AD-CH1 from the memories 139 and 141 through the memory controllers 138 and 140, respectively, and 
performs the correlation calculation for the calculation data in a later-described method, thereby calculating gain cor- 
5 rection data GN1 and offset correction data OF1 for the output AD-CH1 . Here, it is sufficient by correcting either one of 
the outputs AD-CH1 and AD-CH2 to eliminate the unbalance between these outputs. Thus, either one of the correction 
data GN2 and OF2 for the output AD-CH2 and the correction data GN1 and OF1 for the output AD-CH1 may be fixed 
data. 

[0102] Next, an example of algorithm to correct the amount of unbalance will be explained with reference to a flow 
10 chart shown in Fig. 10. In this example, luminance values are discriminated for the continuous areas c (y) and d (y) as 
shown in Fig. 9, and the correlation calculation of the two outputs is performed by using the discriminated results. How- 
ever, since the photographed image includes various patterns, if the correlation calculation is simply performed for all 
the continuous areas c (y) and d (y) at the position y in the vertical direction, the area having low correlation (or the low- 
correlation area) is unnecessarily calculated, whereby there is some fear that the calculated amount of unbalance 
is becomes far apart from an actual amount of aberration. In order to solve such the problem, there is a method for paying 
attention to the area having high correlation (or the high-correlation area) and performing the correlation calculation 
only to such the area. As the area having high correlation, an area which has uniform luminance and in which there is 
no unevenness of luminance at the boundary and its vicinity can be considered. For example, when a portion of cloud- 
less sky is in the central boundary of an image of scenery photograph, it is considered that the correlation between the 
20 two outputs is high at such the portion. Conversely, in an image obtained by photographing a building, when the bound- 
ary of the building and sky is in the boundary or its vicinity of the two outputs, it is considered that the correlation 
between the two outputs is low. As a method for concretely discriminating such the high- and low-correlative areas, a 
method for discriminating luminance, a method for discriminating tones, a method for discriminating frequencies and 
the like may be devised. 

25 [0103] In the present embodiment, the correlation is discriminated in a steps 151 to 153 of Fig. 10. First, the lumi- 
nance of each of the two outputs is discriminated in the step 1 51 . In the portion where the luminance of the left picture 
is considerably different from that of the right picture, it is discriminated that the correlation of this portion is low. Here, 
in the areas c(y) and d(y) of the arbitrary position y in the vertical direction of Fig. 9, the average value of the image data 
is calculated, and the calculated result is given as the luminance. If the calculated result in the area c(y) is considerably 

30 different from that in the area d(y), it is discriminated that the correlation of the image data in the areas c(y) and d(y) is 
low. At this time, a threshold value is necessary to discriminate the difference of the luminance. However, when the 
threshold value is set to be a primary function of the luminance value in preconsideration of the gain aberration amount 
and the offset aberration amount, the portion having low correlation might be able to be discriminated in high accuracy. 
[0104] Next, the tone between the two outputs is discriminated in the step 152, and it is discriminated that the cor- 
- 35 relation of the portion in which the left tone is different from right tone is low. Like the step 1 501 , in the areas c(y) and 
d(y) of the arbitrary position y in the vertical direction, the average value of the image data for each color filter is calcu- 
lated, and further the calculated results of the areas c (y) and d (y) are compared with each other for each color filter. 
When the results are considerably different from each other, it is discriminated that the correlation of the image data in 
the areas c (y) and d (y) is low. If the threshold value which is a reference of discrimination is set to be a primary function 

40 of the luminance value for each color filter, the portion having low correlation can be discriminated in high accuracy. 
[01 05] Next, the frequency is discriminated in the step 1 53, and it is discriminated that the correlation of the portion 
with a lot of high frequency components is low. In this case, the average value y of the image data is calculated in the 
area c (y) of the arbitrary position y in the vertical direction. It is assumed that luminance data in the continuous area c 
(y) is Y, and the number of luminance data is n. Then, in the area c (y), a dispersion value o 2 is calculated by an expres- 

45 sion a 2 = Z(Y - y) 2 In . Similarly, a dispersion value is calculated in the continuous area d(y). When the dispersion 
value is considerably high, since the image data in the areas c(y) and d(y) includes a lot of high frequency components, 
its correlation is discriminated to be low. This dispersion value has a tendency which grows by an increase of the aver- 
age value of the luminance. Thus, if the threshold value for discrimination is set to be a primary function of the average 
value of the luminance, the portion having low correlation can be discriminated in high accuracy. Besides the method 

so for calculating the dispersion value, as a method for discriminating the frequency, it is possible to similarly discriminate 
the frequency by obtaining and appropriately combining a maximum value, a minimum value, an average deviation, a 
standard deviation, a difference maximum value, a difference minimum value and a difference average value. Here, the 
standard deviation is represented by a square root of the dispersion value. If it is assumed that the data is Y, the number 
of data is n, and the average of the data is y, then a standard deviation value a is calculated by an expression 

55 a = X|Y - y| /n . The difference maximum value, the difference minimum value and the difference average value repre- 
sent the maximum value, the minimum value and the average value in the absolute value of the difference between the 
data of the adjacent positions, respectively. 

[0106] After such the processing as above is performed, the position which is not discriminated in a step 154 that 
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its correlation is low is considered as the position where the correlation between the left and right pictures is high. In the 
above processing, the luminance, the tone and the frequency are discriminated for the correlation discrimination. How- 
ever, it is possible to discriminate the correlation by discriminating only one or two of such factors. 
[0107] Next, in a step 155, the following correlation calculation is performed only for the line where it is regarded 
5 that the correlation between the left and right pictures is high, whereby the correction data is calculated to correct the 
unbalance of the two outputs. 

[0108] When luminance data G L (y), R L (y) and B L (y) to the output AD-CH2 and luminance data G R (y), R R (y) and 
B R (y) to the output AD-CH1 for each color filter are used only for the position y where it is regarded that the correlation 
is high, the difference between the left and right luminance values for each color filter is squared and summed by the 
10 following expression. 

£(GN1 x G R (y) + OF1 ■ GN2 x G L (y) - OF2) 2 + £(GN1 x R R (y) + OF1 - GN2 x R L (y) - OF2) 2 
+ X(GN1 x B R (y) + OF1 - GN2 x B L (y) - OF2) 2 

75 

[0109] By obtaining the combination of the gain correction data GN1 and GN2 and the offset correction data OF1 
and OF2 for minimizing the value of the above expression, it is possible to calculate the correction data for the outputs 
AD-CH1 and AD-CH2 to match the levels of the two outputs with each other. Here, since either one of the two outputs 
20 is fixed and the other thereof is matched with the one output to correct the unbalance between the two outputs, either 
the set of the data GN1 and OF1 or the set of the data GN2 and OF2 may be the fixed data. Further, when only an offset 
error and a gain error are corrected, the offset correction amount and the gain correction amount may be the fixed data 
respectively. 

[0110] Next, in a step 156, the gain correction and the offset correction are performed respectively to the left and 
25 right image data as a whole, by using the correction data GN1, GN2, OF1 and OF2 calculated in the above manner. 
Thus, it is possible to accurately correct the unbalance between the two outputs. 

[0111] Next, the fifth embodiment will be explained. Fig. 11 is a flow chart showing an example of algorithm to 
explain the fifth embodiment of the present invention. The hardware structure of the entire image pickup apparatus and 
the concrete structure of the unbalance amount calculation circuit are the same as those in the fourth embodiment. Like 

30 the fourth embodiment, the area shown in Fig. 9 is discussed. 

[0112] In the present embodiment, the gain correction amount and the offset correction amount are independently 
calculated. The unbalance between the left and right pictures at the dark portion substantially depends on an offset 
error. Thus, there is a possibility that calculating only the offset correction amount in such a manner as above can cal- 
culate the amount of correction more accurately, rather than calculating the gain correction amount and the offset cor- 

35 rection amount simultaneously. For this reason, in step 158, only the black portion in the image, i.e., the area the 
luminance value of which is close to zero, is discriminated, and then the offset correction amount is calculated from the 
discriminated result in a step 160. 

[01 1 3] The luminance discrimination, the hue discrimination and the high frequency discrimination in the steps 1 51 , 
152 and 153 are the same as those in the fourth embodiment. 
40 [01 14] Next, in step 1 62, a white saturation portion is discriminated. The white saturation portion is the portion such 
as a spot portion or the like in the object, where the luminance is extremely high. Since the data is saturated in the white 
saturation portion, there is a possibility that the amount of unbalance of this portion is different from that of another por- 
tion, whereby it is regarded that the correlation between the two outputs is low. 

[0115] Next, in steps 163 to 165, 167 and 170, the correlation calculation to be performed is made differently 
45 according to whether or not the amount of the portion the correlation of which is discriminated to be high and the offset 
correction amount have been calculated. First in the step 163, it is discriminated whether the portion having the high 
correlation has sufficient size to obtain the accurate amount of unbalance in the correlation calculation. If it has suffi- 
cient size, the correlation calculation is performed, while if it does not have sufficient size, it is considered that unbal- 
ance correction is unnecessary because the correlation between the two outputs is originally low. It is discriminated in 
so the step 164 whether or not the portion having the high correlation is all a black portion. If so, like the step 163, it is con- 
sidered that the correlation between the two outputs is originally low. Besides, in the step 167, when the offset correc- 
tion amount has been already calculated, it is controlled that only the offset error is corrected. Conversely, when the 
offset correction amount is not calculated, the gain correction amount and the offset correction amount are determined 
in the step 170 such that the unbalance correction is not performed. Next, when the portion where the correlation 
55 between the two outputs is discriminated to be high satisfies the condition necessary for the correlation calculation, it is 
discriminated in the step 165 whether the offset correction amount has been calculated. When the offset correction 
amount has been calculated, only the gain correction amount is calculated by the correlation calculation in a step 166, 
while the offset correction amount is not calculated, both the offset correction amount and the gain correction amount 
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are calculated by the correlation calculation in a step 169. 

[0116] Next, like the fourth embodiment, the unbalance correction between the two outputs is performed based on 
the calculated amount of unbalance in the step 156. whereby it is possible to accurately correct the unbalance between 
the two outputs. 

5 [0117] Next, the sixth embodiment will be explained with reference to the circuit structures shown in Figs. 12A and 
12B. 

[01 1 8] Fig. 1 2 A shows the structure in a case where the reading from the image pickup element is divided into two 
reading for up and down areas. The upper-half output read from an image pickup element 170 is converted into digital 
data by an A/D converter 173 through a CDS/AGC circuit 1 71 , and then input to, e.g., the memory controller 8 of Fig. 3. 

10 [0119] Similarly, the lower-half output read from the image pickup element 170 is converted into digital data by an 
A/D converter 174 through a CDS/AGC circuit 172, and then input to, e.g., the memory controller 10 of Fig. 3. 
[0120] Fig. 12B shows the structure in a case where the reading from the image pickup element is divided into four 
reading for up and down, left and right areas. The upper-left 1/4 output read from an image pickup element 175 is con- 
verted into digital data by an A/D converter 180 through a CDS/AGC circuit 176, and then input to, e.g., the memory 

is controller of Fig. 3. 

[0121 ] The upper-right 1/4 output read from the image pickup element 1 75 is converted into digital data by an A/D, 
converter 181 through a CDS/AGC circuit 1 77, and similarly input to the memory controller. 
[0122] The lower-right 1/4 output read from the image pickup element 1 75 is converted into digital data by an A/D 
converter 182 through a CDS/AGC circuit 178, and then input to, e.g., the memory controller of Fig. 3. 

20 [0123] Similarly, the lower-left 1/4 output read from the image pickup element 175 is converted into digital data by 
an A/D converter 183 through a CDS/AGC circuit 179, and then input to the memory controller. 
[0124] In the above first to sixth embodiments, the image pickup element 1 and the other unbalance amount calcu- 
lation circuit, the system control CPU, and the like may be formed respectively on different semiconductor substrates, 
or on an identical semiconductor substrate by CMOS processing or the like. 

25 [01 25] The image pickup apparatus according to the above first to sixth embodiments bring the following effects. 
[01 26] The amount of unbalance of the plural outputs can be calculated from the image data itself output from the 
plural output terminals of the image pickup element simultaneously. Thus, the output unbalance changed due to an 
environmental change or the like after level adjustments of the plural outputs at the manufacturing stage can be auto- 
matically corrected, whereby non-continuity such as unevenness or the like appearing on the photographed picture can 

30 be apparently eliminated. 

[0127] Further, the amount of unbalance among the plural outputs can be calculated from the part of the image 
data output from the plural output terminals of the image pickup element simultaneously. Thus, the output unbalance 
changed due to an environmental change or the like after level adjustments of the plural outputs at the manufacturing 
stage can be accurately and automatically corrected, whereby non-continuity such as unevenness or the like appearing 

35 on the photographed picture can be apparently eliminated. 

[0128] Further, the present invention has the photographing mode to discriminate the amount of unbalance among 
the image data output from the plural output terminals of the image pickup element simultaneously. Thus, as long as 
the photographer must perform the photographing in the photographing mode beforehand, the amount of unbalance 
among the plural outputs can be easily discriminated, whereby non-continuity on the photographed image in the actual 

40 photographing can be eliminated based on the discriminated result. 

[0129] Further, the present invention has the photographing mode to discriminate the amount of unbalance of the 
image data output from the plural output terminals of the image pickup element simultaneously. Thus, when the pho- 
tographer performs the photographing in the photographing mode beforehand, it is possible to generates warning to 
indicate to the photographer that the photographed scene is inappropriate, thereby enabling to urge the photographer 

45 to perform photographing for appropriate calibration. 

[01 30] Further, after the image data simultaneously output from the plural output terminals of the image pickup ele- 
ment is once stored in the memory, the amount of unbalance among the plural outputs can be calculated by using the 
part of the memory data. Thus, the output unbalance changed due to an environmental change or the like after level 
adjustments of the plural outputs at the manufacturing stage can be accurately and automatically corrected by the cal- 

so . culation of the CPU or the like while spending time to some extent, whereby non-continuity such as unevenness or the 
like appearing on the photographed picture can be apparently eliminated. 

[0131] The present invention is applicable to a system composed of plural equipments (e.g., a host computer, an 
interface equipment, a reader, a printer, etc.) or to an apparatus including a single equipment (e.g.. a copying machine, 
a facsimile machine or the like). 
55 [0132] It is needless to say that the object of the present invention can be achieved in a case where a storage 
medium storing the program codes of software for realizing the functions of the above embodiments is supplied to a 
system or an apparatus and then a computer (or CPU or MPU) in the system or the apparatus reads and executes the 
program codes stored in the memory medium. In this case, the program codes themselves read from the storage 
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medium realize the function of the above embodiments, and the storage medium storing such the program codes con- 
stitutes the present invention. Further, it is needless to say that the present invention also includes not only the case 
where the functions of the above embodiments are realized by executing the program codes read by the computer, but 
also a case where an operating system (OS) or the like functioning on the computer executes all or a part of the 

5 processing according to instructions of the program codes, thereby realizing the functions of the above embodiments. 
[0133] Further, it is needless to say that the present invention further includes a case where the program codes 
read from the storage medium are once written in a memory provided in a function expansion card inserted in the com- 
puter or a function expansion unit connected to the computer, and then a CPU or the like provided in the function expan- 
sion card or the function expansion unit executes all or a part of the processing according to instructions of such 

10 program codes, thereby realizing the functions of the above embodiments. 

[01 34] Many widely different embodiments of the present invention may be constructed without departing from the 
spirit and scope of the present invention. It should be understood that the present invention is not limited to the specific 
embodiments described in the specification, except as defined in the appended claims. 

15 Claims 

1 . An image pickup apparatus comprising: 

image pickup areas for picking up an image of a object by dividing the image into the plural areas; 
20 plural output portions, each provided for each of said image pickup areas, for outputting image signals respec- 

tively from said image pickup areas; 

calculation means for calculating correlation among the plural image signals respectively output from said plu- 
ral output portions; and 

correction means for performing a correction processing on the plural image signals output from said plural out- 
25 put portions, on the basis of the signal from said calculation means. 

2. An apparatus according to Claim 1 , wherein said calculation means discriminates high-correlation areas and low- 
correlation areas in the plural image signals respectively output from said plural output portions, and calculates the 
correlation of the high-correlation areas in the plural image signals. 

30 

3. An apparatus according to Claim 1 , further comprising image synthesizing means for synthesizing the image sig- 
nals output from said plural output portions. 

4. An apparatus according to Claim 1, wherein said calculation means performs the calculation by using a result of 
35 averaging processing of the image signals from predetermined areas of the respective plural image pickup areas. 

5. An apparatus according to Claim 1 , wherein said calculation means performs the calculation by using the image 
signals from parts of the respective plural image pickup areas. 

40 6. An apparatus according to Claim t , further comprising control means, having a first mode to execute calibration 
and a second mode to execute photographing, for causing said calculation means to perform the calculation when 
said first mode is being selected, and for causing said correction means to perform the correction processing based 
on the calculated result of said calculation means in said first mode when said second mode is being selected. 

45 7. An apparatus according to Claim 6. wherein, in said first mode, said calculation means notifies a photographer of 
the calculated result. 

8. An apparatus according to Claim 1 , wherein said correction means performs at least one of gain adjustment and 
offset adjustment on the image signals respectively output from said plural output portions. 

so 

9. An apparatus according to Claim 2, wherein said calculation means performs the discrimination by using at least 
one of luminance, hue and frequency components of the image signals respectively output from said plural output 
portions. 

55 1 0. An apparatus according to Claim 1 , further comprising analog-to-digital conversion means for converting the image 
signals output from said plural output portions into digital signals, and 

wherein the calculation by said calculation means and the correction processing by said correction means are per- 
formed on the digital signals converted by said analog-to-digital conversion means. 
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11. A control method for an image pickup apparatus which includes image pickup areas for picking up an image of a 
object by dividing the image into the plural areas, and plural output portions each provided for each of the image 
pickup areas, for outputting image signals respectively from the plural image pickup areas, said method comprising: 

a first step of calculating correlation among the plural image signals respectively output from the plural output 
portions; and 

a second step of performing correction processing on the plural image signals output from the plural output 
portions, on the basis of the calculation result in said first step. 

1 2. A storage medium which stores a control program for controlling an image pickup apparatus including image pickup 
areas for picking up an image of a object by dividing the image into the plural areas, and plural output portions each 
provided for each of the image pickup areas, for outputting image signals respectively from the plural image pickup 
areas, said program comprising: 



a first procedure of calculating correlation among the plural image signals respectively output from the plural 
output portions; and 

a second procedure of performing correction processing on the plural image signals output from the plural out- 
put portions, on the basis of the calculation result in said first procedure. 



13 



5/17/2007, EAST Version: 2.1.0.14 



EP 1 033 868 A1 



is 

ZCL. 
SO 



o 

CO Z 

CO o 

III ~ 

cr g2 

0<CLU 



5* 

II 

OLU 



>- 
cc 






>■ 
CC 


CO 




OO 

Q ii l 
















ix. 2 



CO 




14 



5/17/2007, EAST Version: 2.1.0.14 



EP 1033 868 A1 



S-^ f I I I I I I [TTTT 



□□□□□□□□□□□a 

1 1 1 1 1 1 1 1 i xr 



□□□□□□□□□□□□ 



I I I I I I I I I ITT 



□□□□□□□□□□□a 
1 1 1 1 I I 1 1 I 1 I 



□□□□□□□□□□□□ 



I I I I I 1 I I I I XC 



□□□□□□□□□□□a 
I I I I I I I I I 1—1—1 



I 1 I I I I I 1 I I I I 



□ □□□□□□□□□ □a 
TO 



m 



n 



□□□□□□□□□□□□ 



52 



OJ 



LU 

cc 
. a. 

|— LU 
0CQ_ 



LU 

CC 



o 

,Q -LU 

y2 





0 








\ - 














0 



15 



5/17/2007, EAST Version: 2.1.0.14 



EP1033 868 A1 



CD 



DC LU 

38 

OOC 
OQ- 



co 



CO 

UJ * 

lu ^ : 
s^corvj cj> 



o 

C\r 



CD 
tup 

Sen 



5i 

O-GC 
CO <C 



^5 



CM. 



CD 

2 



cd<x:o 



0<CC3 



o 



GO 

Si 



CD 



COOO 



cd 





1— 


CO 


LU 


CM 


-OFFSET 
ADJUSTM 
'CIRCUIT 



SSoc 
Oh 

LUO 
SO 



CM 

o 



CM 

cd 



LU O 

50 



O 
i 

Q 



o 

LU O 



CO 



o 

CD 

o 

o 



LO 



o 

CD 

Q 
O 



O 



CNJ 

o 



CM 



GC 
LU 

> 
DC 

T 



CO 



CD 
CO 
CO 

\ 

CD 
I— 

r 



16 



5/17/2007, EAST Version: 2.1.0.14 



EP 1 033 868 A1 



CM 

O 



CNJ 



GO 

CO 



< 

i| 

85§ 



o 

o<S£ 
ooo 



5- 



< 

o 

Qg 
ooo 



< 



rr TtZJ 

o<9£ 
ooo 




17 



5/17/2007, EAST Version: 2.1.0.14 



EP 1 033 868 A1 



CM 

St 


2 

St 




FIXED 
OUTPUT 




CORRECTION 
DATA 

CALCULATION 
CIRCUIT 









CsJ 
U. 

3 O 

St 


i? o 

St 




FIXED 
OUTPUT 




CORRECTION 
DATA 

CALCULATION 
CIRCUIT 



°3 
£2o 

QO 



5 



o 

IS 



o 



COO 



8 



LU 

is 

O-JI— 



CNJ 

X 

o 

I 

Q 
< 




18 



5/17/2007, EAST Version: 2.1.0. 



EP1 033 868 A1 




CO 
CO 




CO 
CO 




o<o 



EC 
O O 

it 



5 



eiso 



CO 

m 



CO 

in 



I 



o 



2S0 
oso 



csj 

CD CD 
a 



OW-PASS 
ILTER 


CD 


OW-PASS 
ILTER 




OFFSET 
SETTING 
CIRCUIT 


—ILL- 




1 U_ 









jigs 

ZjcoOO 



CM 



o 

LU 



ZjcoOO 



LU 

of 

uj o 
SO 



CM 

o 

I 

Q 



CO 

in" 



m 



COO 





OC 




LU 


>- 
oc 


O 


0 


1 


LU O 




O 



in 
in 

i 



o 



goo 

f^QO 



o 



o 
in 



o 
1 

o 



o 
f=oo 



Q 



19 



5/17/2007, EAST Version: 2.1.0.14 



EP 1 033 868 A1 




5/17/2007, EAST Version: 2.1.0.14 



EP 1 033 868 A1 




IT) 


CD 











ill cc 



COOO 




CO 



uJ 7 



21 



5/17/2007, EAST Version: 2.1.0.14 



EP 1 033 868 A1 



FIG. 9 



G 


R 


B 


G 



-148 



CM 



d(y) 



149 



POSITION y- 



LEFT 

PICTURE 

PLANE 



I I IT 









































































RIGHT 

PICTURE 

PLANE 



22 



5/17/2007, EAST Version: 2.1.0.14 



EP 1 033 868 A1 



FIG. 10 

( START V m 



DISCRIMINATING 
LUMINANCE 

I 



DISCRIMINATING TONE 



DISCRIMINATING 
FREQUENCY 



SELECTING PORTION 
HAVING HIGH 
CORRELATION 



CORRELATION 
CALCULATION 
OF LUMINANCE 



CORRECTING UNBALANCE 



c end y ' 57 



23 



5/17/2007, EAST Version: 



EP 1 033 868 A1 



FIG. 11 



p™r-> ^ 150 l58 



E 



DISCRIMINATING BLACK PORTION 



I 



DISCRIMINATING LUMINANCE 



151 



DISCRIMINATING TONE 
E 



Y 



152 




DISCRIMINATING FREQUENCY 
t Z 



153 



CALCULATING OFFSET 
CORRECTION AMOUNT FROM 
ONLY BLACK PORTION 



DISCRIMINATING WHITE 
SATURATION PORTION 

1 



SELECTING PORTION HAVING 
HIGH CORRELATION 



161 



162 



PORTION 
HAVING HIGH 
CORRELATION HAS ENOUGH 
AREA FOR CORRELATION 
CALCULATION 
? 



163 



167 



NO 



r YES 

'PORTION 
HAVING HIGH 
CORRELATION IS ALL 

.BUCK PORTION 
o 

'NO 



164 



YES 



OFFSET 
CORRECTION AMOUNT 
HAS BEEN ALREADY 
CALCULATED 
t 



YES 



GAIN CORRECTION 
AMOUNTS 
OFFSET CORRECTION 
AMOUNT=0 



GAIN CORRECTION AMOUNTH | — i 



169 



^ OFFSET^: 

CORRECTION NO 
CAMOUNT HAS BEEN ALREADY^^ 
CALCULATED 

^^L^ 166 

Tyes j 


CALCULATING GAIN CORRECTION 
AMOUNT AND OFFSET CORRECTION 
AMOUNT BY CORRELATION 
CALCULATION OF LUMINANCE 




CALCULATING GAIN CORRECTION 
AMOUNT BY CORRELATION 
CALCULATION OF LUMINANCE 


CORRECTING UNBALANCE | 

1 r-iND-^ 1 " 



24 



5/17/2007, EAST Version: 2.1.0.14 




25 



5/17/2007, EAST Version: 2.1.0.14 



EP 1 033 868 A1 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



EP 00 30 1592 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate, 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (lntCL7) 



US 5 737 015 A (JUEN MASAHIRO) 
7 April 1998 (1998-04-07) 

* column 4, line 35 - line 40 i 

* column 4, line 46 - line 48 4 

* column 6, line 17 - line 21 1 

* column 7, line 13 - line 16 1 



1,3,5-12 



H04N3/15 



TECHNICAL FIELDS 
SEARCHED (lntCI.7) 



H04N 



The present search report has been drawn up for all claims 



Place of eejuch 



THE HAGUE 



Oata ol completion of the March 

31 May 2000 



Bequet, T 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant If taken alone 

Y : partioularty relevant if combined with another 

document of the same category 
A : technological background 
O : non-written disclosure 
P : intormedu 



T : theory or prtnople underlying the invention 
E : earlier patent document, but published on, or 

after the filing date 
D : document oited in the application 
L : document oited (or other reasons 

& : member of the same patent family, oorretpondmg 
document 



26 



5/17/2007, EAST Version: 2.1.0.14 



EP1 033 868A1 



ANNEX TO THE EUROPEAN SEARCH REPORT 

ON EUROPEAN PATENT APPUCATION NO. EP GO 30 1592 



THa annex lists the patent family members relating to the patent documents oited in the above-mentioned European search report. 
The members are as contained in the European Patent Office BOP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 



31-05-2000 



Patent document 
cited in search report 



Publication 
date 



Patent family 
members) 



Publication 
date 



US 5737015 



07-04-1998 



JP 7038812 A 



G7 -02 -1995 



For more details about this annex : see Official Journal of the European Patent Office, No. 12/82 



27 



5/17/2007, EAST Version: 2.1.0.14 



